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THREE-DIMENSIONAL MECHANICAL MOUSE 

FiELDCiJHiJWE^^ 
• • .ntinn relates to a computer-human interlace device, and more 

^sm..— — — 

providing commands to a computer. 

BABSBMDJfJHJJN^ 

the use of Computer Aided Design (CAD) Systems becomes more 

users to control a cursor wiui h »nd-held input devices 

which allow users to MM - • W """""J ^ lhese Woes 
rltouse^resaea^oesw^are^eltowese,. 

control «. ,e ,e o, so— to = - ^ ^ ^ 
control or dexterity. 
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Another prio, art exampie is !«*»**« "" 

shown HTpat No. 5.142.506. TOs device «W P— - * 

1 U. or enhance ,e, coolro, o, M . - *» " - 

k , . „* k orasoed in the palm of the hand. The use of such a styles 
wi m a styles that • grasped I ■ ^ ^ use , 

preclufles rm POS;^ * I «s device Is used - digifa, 

'° ^JZTSZ'^ command A Pot™ o, ,ls type 

~ve fhe styles from » — P-* ««"** * Ke 
commands are ditfioelt to control unde, many circumstances. 

. |MM ,DvnnnPIMVEMTIOH 

,„ * e present invert, the user Wfe. styles * is supported by * 
sup port apparatus on a fixed surface so that me use, can easily mandate h 
I in 1 apace to interact with a compute,. The three—al moho n o the 
lT m Jd fhhough the «yh» and mechan.ee, Hv « a 
ZL lm m *e computer, » allowing commands » he sen, to the o mputer 
IXae* one three-dimensiona, modon o, tne use,. Tnetefo,, ourso, oonttol „ 
dimensions on the two-dimensional compute, screen is possible. 

,„ one embodiment, the stylus is supportable on a fixed surface Py a set of 
mechanical linkages which include individual components ioined together by a 

n J of ioints to aliow several degrees o, freedom hn dte modon o, the 
stvlu s These mechanical linkages provide mechanical leverage, hthdo , 
ZLLm. and/or apfing resistance in order ,o ,educe fadgue o, U use, and 
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to provide support to enhance the stability and dexterity of user manipulation of the 
stylus. 

I„ We aforementioned embodiment of ttte present invention, the joints ot the 
mechanical linkages are coupled to sensors which provide information about Mr 
posidon. Such information is transmitted to a mioroptooessor so that posihon and 
orientauon of the stylus can be computed us*, Wnematio eguabons associated w,th o, 
related to the parucular linkage system: In another embodiment, position and 
oriental of the stylus is sensed through ttte use of uhrasonic, magnehc, or opttcal 
position and orienution sensors mounted on the stylus. 

Another aspect of the ptesent invention includes a remote control unit which is 
used in place of a command olioker on me stylus. For example, a foot pedal or hand- 
M d unit fo. the user's opposhe hand is included to provide command control to the 
computer. Accordingly, manual dexterity of stylus manipulation is not composed. 
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nporoiPTinN OF THE DRAW INGS 
Figure 1 is a perspective view of an embodiment of the present invention; 

Figures 2A and 2B are block diagrams over-viewing two different electronic 
hardware configurations of the present invention; 

Figure 3 is a flow chart describing the main software loops for two different 
electronic hardware configurations shown in FIG. 2; 

Figures 4A and 4B are flow charts describing two different interrupt sen/ice 
routines for serial output to host computer, 



Figure 5 is a 
10 invention; 



perspective representation of another antbooiment ot the present 



Figure 6 is a perspective view ot still another embodiment ot the presant 
invention; 

Figure 7 is a perspective representation of another embodiment; 
Figure 8 is a perspective view of another embodiment; 

embodiment ot the resistance mechanism of the present 



15 Figure 9 shows an 

invention; 



Figure 10 shows another embodiment of the resistance mechanism; and 
Figure 11 shows yet another embodiment of the resistance mechanism. 
ppcppiPTiriM OF PREFERRED PMRODIMENTS 



SUBSTTTUTE SHEET (RULE 26) 



WO 95/02801 



PCT/US94/07851 



Referring to FIG. 1, . stylus 11 Is shown attached to a support apparatus 

oiler or other compuhng «-» «* » a " """" * 

computer Wee-dimensional space. This 

r ^ on a computer dispiay appar*. The 

im orma«on is men nM me ^ „ , CUIS0I 

^ ,1 may Pe us. , « c ; an9 , ng me ^ ,„ W r orient o. 

or where 1o move the cursor on a computer display apparafcs. 

tm ^ fl is a pen-like she* which can Pe manipulated between the 

Z un Pie to manually manipulate a pen. A *lus o, the present — oee 
iriL. Put may he curved or angled so tha, . ma y he held, tor example, h, «t, 
q loot or the mouth ot a person. 

Because the stylus Is supported Py * support apparatus which is in turn 

SUPP or,eZ « i» - - — ■ w usm can ma t a : e 

the stylus L a minimum o, e«ort Also, it » user chooses to d— us g the 
s*J it is capable ot maintaining its poshion in space, unattended. «* « 
2s « pled emhodimen, o. the present invenhon. BGS. ,8 show tern «e 
ZLJ* -h which are also contemplated under the present — « . 
pre ,erable that the stylus have enough degrees o. treedom to enahle t to m v 
2£ I. mechanical H, » *. hie user the amount o, mm needed o 
in cursor as desired. In FIG. 1. « degrees o. treedom are shown and are 
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MM as Axis' 16. This, oi course, port* maximum Mbility. fewer * 
Z.1 » a p«y o, de.ees o, freedom, may also be s*,en, depend^ 

on the application. 

In „„ e embodiment. toe stylus k connected to rtgid individual components 
^ ,™«,»r hv ioints While not shown, other types of support 

S a - ot an, other move* -a support* common which 

oan support the stylus in the manner described herem. 

i n fig , omeohanioal linkage pursuant to the present invenhon is depicted^ 
T „e Jl 11 is'coupled to supportable meobanioa, ,inka 9 es * » « ** » » 

it— — — «*- ~ rri"" 

low 15 baving posidon sensors 16A and 16B, to Wage 17. Jornt 18 in turn 
'! « Jpe 17 - » verdoai base proton 20 which emanates born * 
oase 21 The sensora are used to produce a stylus locadva srpna, which ,a 
lonsive to and corresponds with toe posidon oi the stylos at any point ,n tone 
Z l laloperadon. The s^os ,«ad,e signal is need to provide — 
^ e by a computor display apparatus o, a computer. The term -pn a d 
r i is mm to mean toe connecdon mecbaniam between indlvrdoa, «a 9 e 
ZZ. in -not «wo separate moveable members oan be ioined; snob togetoer 
20 forming a joint. 

Tne base 21, « necessarily, oan be immobilized by securing it onto the fixed 
surtace 23 by way oi bolt, screw or other attachment mechanism 22. Moreover, toe 
;Z Lenin Implements mechanics, ,eve,a 9 e and robbin, W odon (not show, 
etween toe supportable mecbanioel linkages 14 and 17 and toe ,o,nts 1215 and IB 
„r«! Ptol residence and support so as to allow bene, dexler,, toan can be 
IZ wl slylus backer, This support end leverape aids ,n reduc,n 9 

,he fasgue associated wdh manipulating toe 1ree-lloa«n 9 stylos 11. 
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As mentioned above, attached to each joint 12 15 and 18 are sensors 13A, 
13B, 16A, 16B, 19A, and 19B. respectively. These sensors sense the angle differential 
before and after motion of the two segments connected by that joint. The sensors can 
be, for example, optical incremental encoders, optical absolute encoders and 
potentiometers. Because the three-dimensional position and/or orientation tracking is 
achieved mechanically, this preferred embodiment avoids problems that magnetic and 
ultrasonic sensors, such as those shown in the prior art, encounter with metal and 
shadowing. However, as shown in FIG. 1, if desired, sensing means can be used to 
track the position and/or orientation of the stylus by mounting a single or several 
orientation sensors in the stylus 11 itself, such referred to as a stylus mounted 
sensor 11. An ultrasound, magnetic, optical or position and orientation sensor can be 
used as the stylus mounted sensor 11. 

FIG. 1 also shows a clicker button 24 on stylus 11. The button is connected 
to a switch which when in the on state, sends a signal to the computer giving it a 
command. In order to provide for accuracy when sending commands, this invention 
also includes a remote clicker unit. Therefore, since the clicking motion occurs at a 
distant location from the cursor control, there is little or no opportunity to accidently 
move the cursor while making a command. FIG. 1 shows two configurations for 
implementing this aspect of the present invention. The first is identified as an alternate 
hand-clicker 25, the second as foot pedal 26. 

Digital buttons 27 and 28 which are connected to switches (not shown) on the 
remote attached peripherals such as a hand-held clicker unit 25 or a foot pedal 26, 
respectively, can generate additional digital input such transmitted through lines 25' 
and 26 J respectively. Either of the shown ancillary remote command units, such 
including the hand unit 25 and the foot pedal 26 configurations, are favorable methods 
of inputting digital commands by command hardware or software (not shown) because 
pressing the button 27 or 28 does not compromise a user's ability to hold the stylus 
steady whereas pressing any button 24 on the stylus does compromise stylus stability. 
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Referring to FIG. 2A. the sensors 13A 13B. 16A, 16B, 19A and 19B, along 
with any peripherals 24, 25 or 26. can send their digital signals directly to a versahle 
tloating-point processor or microprocessor 32A which is controlled by software stored 
in a digital ROM (Read-Only Memory) via transmission line 32' or another form of 
transmission, i.e.. radio signals. As shown in FIG. 2B, an alternative embodiment can 
be used to lessen the demands on the floating-point processor or microprocessor 32B. 
The digital inputs of the sensors 13A. 13B, 16A 1« «A and 19B can be sent 
indirectly to the floating-point processor or microprocessor 32B by way of dedicated 
chips 13C 13D. 16C, 16D, 19C and 19D, which pre-process the angle sensors 
signals before sending them via bus 31 to the floating-point processor or 
microprocessor 32B which would combine these signals with those from the 
peripherals 24. 25 or 26. An 8-bit data bus plus chip-enable lines allow any of the 
angle determining chips to communicate with the microprocessor. Moreover, reporting , 
the status of peripherals 24. 25 or 26 includes reading the appropriate digital switch 
and placing its status In the output sequence array. Some examples of specific 
electronic hardware usable for sensor pre-processing include quadrature counters, 
which are common dedicated chips that continually read the output of an optical 
incremental encoder and determine an angle from it. Gray decoders, filters, and ROM 
look-up tables. 

The single-chip configuration of FIG. 2A is most applicable where the angle 
sensors 13A, 13B. 16A, 16B. 19A and 19B are absolute sensors, which have output 
signals directly indicating the angles without any further processing, thereby requiring 
less computation for the microprocessor 32A and thus little if any pre-processing. The 
multi-chip configuration of FIG. 2B is most applicable if the sensors 13A, 13B, 16A, 
16B, 19A and 19B are relative sensors, which indicate only the change in an angle and 
which require further processing for complete determination of the angle. 

in either configuration, if the microprocessor 32A or 32B is fast enough, it will 
compute stylus 11 position and/or orientation (or motion, if desired) on board the 
embodiment and send this final data through any standard communications interface 
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soch as an RS-232 sedal interface 33 on «o <he host computer system 34 and 

computer mm «— «"» " " ttnlal 

emission It the microprocessor 32A or 32B is not test enough, then the angles 

7Z , to tlte host computer 34 which « perform fhese c*c«oos on ,«s own. 

,„ addition to «te single-chip and muld-chip configurate, a vadadon may 
consist of a single microprocessor which reads the peripheral, obtains I. angles, 

i y compul coordinates and orfentadon , the s»lus 11, and supers 
ZL1 * the m «*- 34, Another yadadon ma, cons*o dedrcated 
sub-circuits and specialized or «*mM dips which reads the penpher*. 
Lndors the angle sensors 13A, 133, 16A. 16B, 19A and 19B, detemnne me ,o,n, 

a microprocessor 32A or 32B. 

Software is ord, included in the two microprooessor-Dased configurations 
shown in FIGS. 2A and 2B. The more dedicated hardware , gfcen conftguradon 
.Code, dte less software if requires. The software consists of a ma,n loop (F.G. 3) 
and an output interrupt (FIGS. 4A and 4B). 

Referring to FIG. 3, the main command loop responds to the host computer 34 
and runs repeatedly in an endless cycle. With each cycle, incoming commands from 
the host computer are monitored 36 and decoded 37. and the correspond,^ 
Hd suLnes ,o, reporting nngies. thus stylus posdion and/or orient* (sen 
F ,GS 4A and 4B). ere then executed 38. Two possible subroutines are shown ,n 
F,GS 4A and 4B. When a subroutine terminates, the main command loop resumes 
39 Avanable command will include but are no, limited to: reporting fhe value of any 
ie angie. reporbn, fhe angles o, ail six angies at one time, reporting the values of 
Ts, angles repeatedly until a command is given to cease aforemendoned repeated 
repordng. reporting the status of pedphera, buttons, and settmg oommumo adons 
platers. If » angle sensors require preprocessing, these commands w,l, also 
include resetting fhe angle »aK.e of an, single angle or otherwise mod,ly,ng 
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preprocessing parameters in other applicable ways. Resetting pre-processed angle 
values or preprocessing parameters does not require output data from the device. The 
microprocessor 32A or 32B simply sends appropriate control signals to the 
preprocessing hardware 13C, 13D, 16C, 16D, 19C, and 19D. It the microprocessor or 
floating-point processor is fast enough to computer stylus coordinates and orientation, 
these commands will also include reporting the stylus coordinates once reporting the 
stylus coordinates repeatedly until a command is given to cease, ceasing 
aforementioned repeated reporting, reporting the stylus coordinates and orientation 
once reporting the stylus coordinates and orientation repeatedly until a command * 
given to cease, ceasing aforementioned repeated reporting. It force reflection is 
supported, these commands will also include reporting the forces felt by any single 
joint, setting the resistance of any single joint, and locking or unlocking a joint. 

Any report by the subroutines of FIGS. 4A and 4B of a single angle value 
requires determining 41 the given joint angle. For the single-chip configuration shown 
in FIG 2A. this subroutine directly reads the appropriate angle sensor 42 from among 
sensors 13A. 13B. 1BA. 16B. 19A. and 19B. For the multi-chip configuration shown in 
FIG. 2B, this subroutine reads the outputs 43 of pre-processing hardware 13C, 13D. 
16C 16D, 19C. and 19D which have already determined the joint angles from the 
outputs oi the sensors 13A, 13B. 16A, 16B, 19A, and 19B. Any report of multiple 
angles is accomplished by repeatedly executing the subroutine for reporting a single 
angle The subroutine is executed once per angle, and the values of all angles are 
then included in the output sequence array. If the optional parts of the subroutines 45 
are included, then these subroutines become the coordinate reporting subroutines. 
Many other commend subroutines exist and are simpler yet in their high-level structure. 

After determining the given joint angle, the microprocessor 32A or 32B creates 
an output sequence 44A or 44B by assembling an array in a designated area of 
processor memory which will be output by the microprocessor's communications 
system at a given regular communications rate. The sequence will contain enough 
information for the host computer 34 to deduce which command is being responded 
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t0 as well as the actual angle value .ha. was recusal*, blurring .0 FIG. 3 a query 
36 in U main command loop as* winner the previous command tequested repeated 
L* 1 eo. .he main command loop is Maud accordingly. The communions 
otfpu. process (no, shown) ma, be as simple as storing to oufipul date in a 
Jgnated outpu, buffer, or I. may involve a standard se, o. communions Mff* 
m arc an addifional part of M sottwete. Setting communicate parameters does 
„„, re ,ulre outpu, date ttom ttre device. Tne mlcroprocessot 32A 0, 32B simply 
resets some of Its own internal registers or sends control signals » ns 
communications sub-unit 

To report the stylus' 11 coordinates, three ot the five or six angle values 
pureed and knowledge 0. H lengths and device Wnemafics are incorporated .0 
compute stylus 11 coordinates. Tnese ooondina.es are men assented in fits otnpu, 
sequence array. 

To report ttte stylus' 1 1 orientation, at least five angle values ate read and 
knowledge ot M lengths and device kinematics ate incorporated to compute, 
stytus 11 orientation. The onentafion consists 0. three angles (not necessanly 
identical ,0 any loin, angles) which ate included in the output sequence array. 

Forces felt by a ioin., setting a joint's resistance, and locking ot unlocking a 
loin, ate reported by using interaction of the microprocessor 32A or 32B wrth 
( orced,ef,ecting hardware (no. shown). Report*, forces felt by a Joint uses a force 
sense, mounted on tee ioin. and then places me re-ng vafue in tee output sequence 
array To se. a mint's resistance and locking or unlocking a ioin, control signals 
reading from a foroe sensor ,0 force-reflection hardwate but do not require any output 
data of the device. 

Also contemplated in five present invention is computer software and hardware 
which will provide feedback intotmauon from me computet to the stylus (not shown). 
This type of implementation is known in robotics and thus is easily incotpotated ,nto a 
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system MM •» P-» »""*»• Wn 3 ' S °" ** ^7' 

w generators tot generating force in response to the ouroor pos»n on the surface 
m l on to computer soree, Force is applied for example, by added tension ,n 
the joims which is in proportion to the force being applied by the user and . 
conjuncflon with the image on the screen. 

The various configurations of the mechanical linkages shown in FIG. 5. FIG. 6. 
FIG 7 and FIG. 8 which have different numbers of individual components and ,«ts 
tnan shown in FIG. 1 are illuefrabve of the numerous possible configures which can 
provide varying degrees of freedom mm in ft. P-esent invenhon. Relemng to FIG. 
5 FIG 6 and FIG. 8. note that a rounded object such as a ball can act as a pot 
Wng motion in three degrees of freedom, ta conjunction with other mechanical 
»JL and attachments, fhis permits sufficient degrees of freedom for the purposes 
o, « present invention. In each figure, the ortenBtlon of the degrees of freedom o. 
each joint is depicted by curved lines, numbered consecutively. 

Briefly FIG. 5 shows a rounded joint 46 at the base such that three degrees of 
motion are available at mat joint FIG. 6 shows a tttree-dimensionally rotatable 
t oonded joint 47 at the base through which one mechanic* linkage can slide linearly 
and where the base is attached to a teed surface 48 such mat the surface does not 
prohibit, impede to movement of the device. FIG. 7 shows an embodiment wh«e 
me basal conned can slide about the base in a two-dimensional plane ,» the cross 
configured 49 on base 51. FIG. 8 shows a mree-dimensionally rotatable rounded 
joint 52 at a perpendicular project from to base 53 through which one meohnmoal 
linkage 54 can slide linearly through the joint 52. 

While any of the above discussed oonfigurabons or others can be used in 
acoordance wim the present invendon, FIGS. 9-.1 show different mechanisms for 
providing resistance to the manual manipulation of the stylus b, the user. FIG. . 
example, shows rehtrn or tension springs 56 on each joint of dte embodiment shown 
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in fig 1 in an altemaive enrolment. FIG. 10. snows coonttr-welglits 57 on each 
ioint Moreover. FIG. 11. snows a combination ol a return or tension spring 56. a 
counter-wigh. 57 and a compression spnng 58. The arrangement o. me resistance 
nanism used should depend upon the con«,»a«on stylus mechanical linhage 
combined, such arrangement preferably chosen to maximfce toe ease w,to wtoch toe 
user can manipulate toe stylus 11 in free space in accordance with the present 
invention. 
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WHAT IS CLAIMED : 

1 A device for use in conjunction with a computer display apparatus and 

a fixed surface, comprising: 
a stylus; 

means supportable on a fixed surface and coupled to said stylus for 
supporting said stylus while allowing at least a plurality of degrees of freedom in the 

motion of said stylus; and 

means for producing a stylus locative signal responsive to and 
corresponding wrth the position of the stylus at any point in time during its normal 
operation, said stylus locative signal providing information for use by a computer 
display apparatus. 

2. A device as recited in Claim 1 wherein supporting means is a 
mechanical linkage. 

3. a device as recited in Claim 2 wherein said stylus locative signal 
means is in communication with said mechanical linkage. 

4. A device as recited in Claim 1 wherein said stylus locative signal 
means is in communication with said stylus. 

5 A device as recited in Claim 1 further comprising: 

a remote unit having switch capable of being in an on state and an off 

state; and . 

command means triggered by said switch when said switch is in its on 

state for generating a command signal for receipt by a computer. 



6. A device as 

unit. 



recited in Claim 5 wherein said remote unit is a toot pedal 
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7. A device as recited in Claim 2 wherein said mechanical linkage includes 
three individual components. 



8. A device as 
at least three joints. 



recited in Claim 2 wherein said mechanical linkage includes 



9. a device as recited in Claim 1 further comprising means for providing 
resistance to the motion of the stylus. 

1 o. A device as recited in Claim 1 wherein said stylus has pencil-like 
configuration which can be manually manipulated. 

11. A device as recited in Claim 1 further comprising: 
feedback means tor generating force by said support means in 

response to force signals provided to said device, said force signals correlated to 
information displayed on computer display apparatus. 

12. A method for interfacing a user and a computer display apparatus, 

comprising the steps of: 

providing a stylus; 

coupling to said stylus a support apparatus supportable on a fixed 
surface for supporting said stylus while allowing at least a plurality of degrees of 
freedom in the motion of said stylus; and 

providing means for producing a stylus locative signal responsive to 
and corresponding with the position of the stylus at any point in time during its normal 
operation, said stylus locative signal providing information tor use by a computer 
display apparatus. 

13. A method as recited in Claim 12 wherein support apparatus is a 
mechanical linkage. 
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14. A method as recited in Claim 13 wherein said stylus iocative signal 
means is in communication with said mechanical linkage. 

15. A method as recited in Claim 12 wherein said stylus locative signal 
means Is in communication with said stylus. 

1 6 A method as recited in Claim 1 2 further comprising the steps of: 

providing a remote unit having switch capable of being in an on state 

and an off state; and 

providing a command signal generator triggered by said switch when 

said switch is in its on state for generating a command signal for receipt by a 
computer. 

17. A method as recited in Claim 16 wherein said remote unit is a toot 
pedal unit. 

18. A method as recited in Claim 13 wherein said mechanical linkage 
includes three individual components. 

19. A method as recited in Claim 13 wherein said mechanical linkage 
includes at least three joints. 

20. A method as recited in Claim 1 2 further comprising means for 
providing resistance to the motion of the stylus. 

. 21 . A method as recited in Claim 1 2 wherein said stylus has pencil-like 
configuration which can be manually manipulated. 

22. A device as recited in Claim 1 1 further comprising the steps of. 
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providing feedback means tor generating force by said support means 
in response to force signals provided to said device, said force signals correlated to 
information displayed on computer display apparatus. 

23 in a computer system having a main unit and cursor control functions 
and command control functions which are triggered remote«y from said main un,t, a 
device for interfacing a user and computer, compns.ng: 

a remote command control unit separate from a cursor control un.t 
having a switch capable of being in an on state and an off state; 

command means triggered by said switch when said sw,tch ,s n rts on 
state for generating a command signal representative of a command from a user to a 

computer; and ... 

transmission means for transmitting said command signal to said 

computer. 

24. A device as recited in Claim 21 wherein said remote command control 
unit is a foot pedal unit. 

25 in a computer system having a main unit and cursor control functions 
and command control functions which are triggered remotely from said main unit, a 
system for interfacing a user and computer comprising the steps of: 

providing a remote command control unit separate from a cursor 
control unit having , switch capable of being in an on state and an off state, 

generating a command signal representative of a command from a user 
to a computer when said switch is in its on state; and 

transmitting said command signal to said computer. 

26. A system as recited in Claim 23 wherein said remote command control 
unit is a foot pedal unit. 
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